tests: Rework tests/installed → tests/kola
authorColin Walters <walters@verbum.org>
Wed, 11 Mar 2020 20:00:14 +0000 (20:00 +0000)
committerColin Walters <walters@verbum.org>
Thu, 19 Mar 2020 16:01:57 +0000 (16:01 +0000)
commitb93180a4d3d95f557826fe613a9ffa16012ebb4a
tree88c8d65f93ebba0268ea7738d58ecf72cfa23562
parent35c8fd3722fbcccd2855d690b80ccdfc95f5fc55
tests: Rework tests/installed → tests/kola

Previously we made an effort to use the [Fedora Standard Test Interface](https://docs.fedoraproject.org/en-US/ci/standard-test-interface/).
This effort was not very successful; the primary thing that
it really died on is Ansible just didn't support rebooting
very well.  I think that's since gotten better, but even
then, Ansible wasn't the best thing for a test framework
for us anyways.

In the meantime Fedora CoreOS happened emphasizing Ignition
and not "post-hoc reconciliation" models like Ansible over
ssh.

And, [coreos-assembler](https://github.com/coreos/coreos-assembler) happened too.

Furthermore, we really need to test OSTree's interaction
with Ignition as we've invented several special things there.

Then most recently, I've been working on having
cosa/kola support running externally defined tests:
https://github.com/coreos/coreos-assembler/pull/1215

There's a lot of things to clean up after this but at least this
works for me:

```
$ cd /srv/fcos
$ cosa kola run -- --parallel 4 --output-dir tmp/kola -E ~/src/github/ostreedev/ostree/ 'ext.ostree.*'
```

NOTE: This *does not* drop ostree binaries into the target.  See:
https://github.com/coreos/coreos-assembler/pull/1252#issuecomment-600623315

This drops our dependency on Python in the installed tests, and
also fixes a few bugs that came up.

I disabled the `itest-bare-user-root.sh` one because it's
entangled with the shell script infrastructure for the unit tests.
48 files changed:
tests/installed/README.md [deleted file]
tests/installed/destructive-ansible.yml [deleted file]
tests/installed/destructive-unit.yml [deleted file]
tests/installed/destructive/README.md [deleted file]
tests/installed/destructive/itest-bare-root.sh [deleted file]
tests/installed/destructive/itest-deploy-selinux.sh [deleted file]
tests/installed/destructive/itest-label-selinux.sh [deleted file]
tests/installed/destructive/staged-deploy.yml [deleted file]
tests/installed/destructive/var-mount.yml [deleted file]
tests/installed/execute_batch.yml [deleted file]
tests/installed/libinsttest.sh [deleted file]
tests/installed/libtest-core.sh [deleted symlink]
tests/installed/nondestructive.yml [deleted file]
tests/installed/nondestructive/itest-bare-unit.sh [deleted file]
tests/installed/nondestructive/itest-bare-user-root.sh [deleted file]
tests/installed/nondestructive/itest-bareuser-nouserxattrs.sh [deleted file]
tests/installed/nondestructive/itest-payload-link.sh [deleted file]
tests/installed/nondestructive/itest-pull-space.sh [deleted file]
tests/installed/nondestructive/itest-pull.sh [deleted file]
tests/installed/nondestructive/itest-remotes.sh [deleted file]
tests/installed/nondestructive/libtest-core.sh [deleted symlink]
tests/installed/playbook-run.sh [deleted file]
tests/installed/provision.sh [deleted file]
tests/installed/run.sh [deleted file]
tests/installed/tasks/disable-all-rpmmd-repos.yml [deleted file]
tests/installed/tasks/install-git.yml [deleted file]
tests/installed/tasks/overlay-git.yml [deleted file]
tests/installed/tasks/query-host.yml [deleted file]
tests/installed/tasks/reboot.yml [deleted file]
tests/kola/README.md [new file with mode: 0644]
tests/kola/destructive/data [new symlink]
tests/kola/destructive/itest-bare-root.sh [new file with mode: 0755]
tests/kola/destructive/itest-deploy-selinux.sh [new file with mode: 0755]
tests/kola/destructive/itest-label-selinux.sh [new file with mode: 0755]
tests/kola/destructive/staged-deploy.sh [new file with mode: 0755]
tests/kola/destructive/var-mount.sh [new file with mode: 0755]
tests/kola/libinsttest.sh [new file with mode: 0644]
tests/kola/libtest-core.sh [new file with mode: 0644]
tests/kola/nondestructive/data [new symlink]
tests/kola/nondestructive/itest-bare-unit.sh [new file with mode: 0644]
tests/kola/nondestructive/itest-bare-user-root.sh [new file with mode: 0755]
tests/kola/nondestructive/itest-bareuser-nouserxattrs.sh [new file with mode: 0755]
tests/kola/nondestructive/itest-payload-link.sh [new file with mode: 0755]
tests/kola/nondestructive/itest-pull-space.sh [new file with mode: 0755]
tests/kola/nondestructive/itest-pull.sh [new file with mode: 0755]
tests/kola/nondestructive/itest-remotes.sh [new file with mode: 0755]
tests/kola/nondestructive/libtest-core.sh [new symlink]
tests/libtest-core.sh [changed from file to symlink]